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SUMMARY 


The  following  report  presents  the  results  of  a  Small  Business  Innovative  Research  Phase  1 
award  to  identify  the  advanced  human  factors  engineering  (HFE)  tools  presently  used,  and 
projected  for  use,  within  the  military  and  civilian  sectors,  along  with  a  categorization  of  these  tools 
based  upon  their  utility  in  facilitating  human  factors  engineering  research  during  the  phases  of  the 
materiel  acquisition  process  (MAP). 

The  approach  taken  began  with  a  search  of  the  literature  to  identify  both  traditional  and 
manual  tools.  Next,  human  factors  specialists  were  surveyed  to  identify  the  HFE  tools  which  are 
considered  most  important,  or  that  are  most  frequently  used  in  the  day-to-day  conduct  of  their  job. 
The  survey  was  geared  toward  both  aviation  specific  and  non-aviation  related  tools.  The  survey 
also  attempted  to  seek  out  those  conditions  under  which  the  tools  are  used,  including  the  phases  of 
the  materiel  acquisition  process.  Both  conceptual  tools  and  tools  in  the  prototype  phase  of 
development  were  considered  candidates  for  inclusion.  The  advanced  tools  were  next  categorized 
using  an  eight  point  classification  scheme  which  included  the  phase  of  the  MAP  in  which  the  tools 
application  would  be  most  appropriate,  together  with  the  tools  activity,  class,  type,  role, 
application,  status  and  cost.  Decision  criteria  were  then  developed  as  the  basis  for  the  tradeoff 
process  to  aid  in  tool  selection. 

To  facilitate  the  inclusion  of  new  technologies  as  they  become  available,  and  to  aid  in  the 
search  and  retrieval  of  a  tool's  capabilities,  the  advanced  tools  were  entered  into  a  data  base. 
Military  HFE  specialists  were  resurveyed  to  gain  insights  to  the  adaptability  of  the  tools  in  meeting 
the  Army's  Test  and  Evaluation  (T&E)  and  Research  and  Development  (R&D)  needs.  The  survey 
resulted  in  the  identification  of  113  advanced  tools,  88  of  which  were  determined  to  contain 
sufficient  information  to  be  included  in  the  data  base.  The  results  of  this  study  suggest  that, 
although  a  large  number  of  tools  presently  exist  that  are  capable  of  helping  HF  specialists  practice 
their  profession,  the  human  factors  engineering  community  would  welcome  additional  tools, 
especially  those  configured  to  run  on  a  desk  top  microcomputer.  Future  emphasis  in  tool 
development  should  focus  on  expert  systems,  human  factors  data  base  compendiums,  workload 
prediction  tools,  and  automated  task  analysis  programs. 
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1.0  INTRODUCTION 


1.1  Preface 

In  support  of  the  Advanced  Human  Engineering  Tools  Workplan  dated  July  28,  1986, 
Carlow  Associates  Incorporated  submits  the  following  report  in  fulfillment  of  Contract 
DAAA15-86-C-0064.  This  contract  was  awarded  in  response  to  an  SBIR  solicitation,  with  this 
report  satisfying  the  final  task  of  the  exploratory  development  effort  as  defined  under  the 
requirements  of  the  Phase  I  SBIR  program.  The  work  described  in  this  report  was  performed  for 
the  U.S.  Army  Human  Engineering  Laboratory  (USAHEL),  at  Aberdeen  Proving  Ground, 
Maryland.  The  technical  monitor  for  this  contract  was  Ms.  Helen  M.  Nicewonger  of  the  Aviation 
and  Air  Defense  Directorate.  The  report  which  follows  represents  the  culmination  of  the  final  task, 
and  presents  our  findings  and  recommendations  surrounding  the  availability  and  use  of  advanced 
human  factors  engineering  (HFE)  tools  by  HFE  researchers  and  practitioners  within  the  academic, 
industrial,  and  military  settings. 

1.2  Scope 

With  the  speed  at  which  information  technologies  are  developing  and  being  integrated  into 
today's  systems,  a  corollary  pace  will  be  required  of  HFE  researchers  if  users  of  the  information 
are  to  be  considered.  Fast  turnaround  is  a  euphemism  as  important  in  science  and  engineering  as  it 
is  in  the  restaurant  business.  While  good  science  and  good  human  factors  cannot  be  rushed,  a 
continued  reliance  on  the  tools  of  the  past  will  most  likely  bring  despair  to  the  hearts  of  those 
relying  on  HF  engineers  for  fast  answers.  Recognizing  the  limitations  of  traditional  technologies 
or  tools  for  satisfying  the  analysis,  design  and  evaluation  demands  associated  with  today's 
advanced  systems,  the  Army  contracted  Carlow  Associates  to  identify  those  advanced  tools  that  are 
presently  available  and  in  use  in  laboratories  and  field  settings  throughout  the  HFE  arena.  The 
report  which  follows  presents  to  the  military  community  the  available  HFE  advanced  research  tools 
which  may  enable  more  expeditious  and  less  costly  development  evaluation  of  the  soldier-machine 
interface. 

The  research  conducted  during  the  course  of  this  contract  is  intended  to  support  the  initiatives 
of  the  Manpower  and  Personnel  Integration  (MANPRINT)  program.  To  ensure  that  the  studies 
conducted  during  the  Phase  I  effort  are  of  maximum  utility  to  the  MANPRINT  program,  a 
scope -of-work  which  compliments  work  that  has  already  been  performed  by  Carlow  Associates 
during  FY  1986  MANPRINT  initiatives  was  proposed. 

In  an  effort  to  develop  a  standard  MANPRINT  process  based  on  USAHEL  human  factors 
engineering  analysis  (HFEA)  approach  conducted  for  FMC  under  its  internal  research  and 
development  (IR&D)  program,  Carlow  Associates  identified  traditional  tools  applicable  to  each  of 
the  MANPRINT  domains.  The  results  of  that  task  yielded  the  identification  of  over  100  models. 
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methods  and  data  bases  used  in  support  of  the  MANPRINT  process.  The  tools  identified 
encompassed  the  domains  of  HFE;  manpower,  personnel  and  training  (MPT);  systems  safety  (SS); 
and  health  hazard  assessment  (HHA).  To  prevent  duplication  of  effort,  the  present  task 
concentrated  solely  on  HFE  tools;  generic  methods  and  techniques  which  have  not  been 
proceduralized  or  modeled,  such  as  task  analysis  and  operational  sequence  diagrams,  were 
excluded  from  the  survey,  as  were  data  base  management  systems  and  dynamic  simulators. 
Similarly,  the  MP&T,  SS,  and  HHA  domains  remained  out-of-scope. 

1.3  Background 

It  was  the  outbreak  of  the  second  World  War  which  established  the  impetus  for  recognizing 
human  factors  engineering  as  a  separate  discipline  within  the  field  of  psychology.  The  war 
produced  systems  of  such  complexity  that  the  common  sense  approach  to  design  was  no  longer 
adequate  for  solving  the  many  problems  of  human  use  introduced  by  the  newly  emerging 
technologies.  In  their  efforts  to  match  these  modem  machines  to  their  human  operators  and 
maintainers,  human  factors  researchers  developed  methods  to  collect  and  analyze  the  information 
needed  for  the  solutions  to  these  problems.  Techniques  were  developed,  or  borrowed  from  other 
specialties,  to  assist  these  renaissance  researchers  in  their  quest  for  a  better  understanding  of  the 
factors  which  influence  human  performance.  These  techniques  in  turn  relied  on  the  use  and 
creation  of  tools  to  match  machines  and  tasks  with  the  abilities  of  their  human  operators.  Many  of 
these  early  tools  are  still  in  use  today.  Anthropometers,  task  analysis  techniques,  motion  picture 
cameras,  sound  pressure  level  meters,  and  the  machinist’s  ruler  are  just  a  few  of  the  many  tools 
which  are  used  by  the  human  factors  researcher. 

It  is  a  sophisticated  skepticism  and  general  mistrust  of  intuition  which  are  largely  responsible 
for  the  success  of  human  factors  engineering.  During  the  war,  this  trait  was  responsible  for 
rallying  the  "nonbelievers"  into  a  mind-set  that  the  design  errors  which  were  plaguing  the  military 
could  be  mitigated  by  the  systematic  application  of  behavioral  principles.  Today,  HFE  researchers 
are  experiencing  a  resurgence  in  popularity  heretofore  unequalled.  The  advent  of  microelectronics 
has  resulted  in  systems  of  increasing  complexity.  The  automated  weapon  systems,  integrated 
command  and  control  systems,  and  "smart"  systems  of  today  are  relying  more  on  the  cognitive 
skills  of  the  human  operators  and  less  on  the  sensory/psychomotor  skills  which  were  required  in 
the  electromechanical  systems  during  the  second  world  war.  It  should  come  as  no  surprise,  then, 
to  learn  that  the  HFE  researchers  and  practitioners  of  today  are  being  called  upon  with  increasing 
frequency  to  apply  their  knowledge  of  cognitive  psychology  to  the  problems  facing  human  users  of 
technologically  advanced  systems. 

Outside  of  the  typical  "mainstream"  tools  generally  associated  with  human  factors 
engineering,  are  those  tools  which  do  not  readily  elicit  recognition  due  to  their  novelty  or  general 
lack  of  citation  in  the  human  factors  literature.  For  example,  SAMMIE,  MAWADES,  and 
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SIMWAM  are  several  automated  aids  which  have  more  recently  been  introduced.  The  application 
and  utility  of  these  alternative  tools  by  HF  engineers  during  the  system  design  and  development  life 
cycle,  however,  have  been  largely  unexplored.  For  the  purpose  of  this  report,  these  alternative  or 
advanced  tools  are  largely  computer  programs.  Included  herein  are  computer  programs  as  diverse 
as  the  first  man-machine  simulation  model,  developed  by  Arthur  Siegel  and  Jay  Wolf  back  in  1969, 
to  the  conceptual  Designers  Associate  expert  system,  which  is  presently  under  development  at 
MacAulay-Brown  Inc.,  in  Dayton  Ohio,  funded  through  an  Aerospace  Medical  Research 
Laboratory  (AMRL)  contract  out  of  Wright  Patterson  Air  Force  Base. 

1.4  Objectives 

The  primary  objective  of  this  contract  was  to  identify  the  advanced  tools  presently  in  use  by 
HFE  practitioners  within  the  military  and  civilian  sectors,  and  to  categorize  these  tools  based  upon 
their  utility  in  facilitating  human  factors  engineering  research  during  the  materiel  acquisition 
process.  This  report  constitutes  the  final  product  of  the  Phase  I  program,  together  with  a  data  base 
which  itself  can  be  used  as  a  tool  in  searching  for  information  on  a  specific  tool,  or  on  the 
appropriateness  of  a  tool  for  a  given  application. 

The  specific  objectives  during  the  exploratory  development  phase  of  this  effort  were  to: 

•  Identify  the  advanced  HFE  tools  which  are  presently  used  in  laboratories  and  field 
settings  within  the  military,  private  industrial,  government  and  academic  settings; 

•  Identify  the  capability  of  these  tools  in  augmenting  or  replacing  the  more  traditional  tools 
typically  associated  with  HFE  research  during  system  development; 

•  Identify  those  advanced  HFE  tools  which  are  adaptable  to  military  research  needs;  that 
is,  tools  that  are  effective  and  reliable,  transportable  (within  the  hardware  compatibility 
context),  and  versatile  enough  to  be  utilized  in  a  variety  of  settings; 

•  Identify  stages  of  the  materiel  acquisition  process  to  which  the  tool  application  is 
appropriate 

•  Identify  decision  criteria  that  can  be  employed  in  a  trade-off  matirx  to  rate  the  overall 
desirability  of  a  tool; 

•  Recommend,  based  on  the  foregoing  steps,  viable  additions  to  the  Army  HFE 
community's  standard  tool  set; 

The  technical  approach  to  meet  these  objectives  is  described  in  Section  1.5  of  this  report. 

1.5  Overview 

The  initial  step  involved  the  development  of  a  work  plan  geared  to  the  objectives  of  the  task 
assignment.  The  work  plan  which  resulted  involved  the  conduct  of  five  tasks:  (a)  review  of  the 
literature,  (b)  survey  of  HFE  professionals  and  manufacturers,  (c)  development  of  a  tool 
taxonomy,  (d)  follow-up  survey,  and  (e)  development  of  cost-effectiveness  trade-off  criteria.  A 
flow  chart  depicting  the  general  flow  of  review  activities  is  presented  in  Figure  1. 


Relationships  of  the  Advanced  HFE  Tool  Survey 


The  first  task  involved  the  conduct  of  a  literature  search.  This  review  served  as  the 
foundation  for  subsequent  tasks.  The  literature  review  focused  on  advanced,  software  oriented 
tools,  as  well  as  on  traditional  human  factors  tools  (e.g.,  photometers),  although  the  emphasis  was 
on  advanced  tools.  Both  automated  and  manual  searches  were  conducted  to  ensure  as 
comprehensive  a  review  as  possible.  The  specific  approach  taken  to  identify  the  tools  currently  in 
use  by  HFE  specialists  is  described  in  Section  2. 1  of  this  report. 

The  second  task  entailed  a  survey  of  human  factors  professionals.  Practitioners  from 
academe,  the  government,  industry,  and  the  military  were  asked  to  participate  in  a  questionnaire 
survey  designed  to  capture  their  knowledge  regarding  the  use  of  HFE  tools.  The  purpose  of  the 
survey  was  to  identify  the  traditional  and  advanced  tools  which  are  presently  used  in  laboratories 
and  field  settings  throughout  the  HFE  community,  and  to  identify  the  capabilities  of  the  advanced 
tools  in  augmenting  the  more  traditional  tools  typically  associated  with  human  factors  research. 
The  methodology  used  to  conduct  the  surveys,  is  described  in  Section  2.2.  The  questionnaire  used 
to  solicit  information  regarding  tool  use  has  been  provided  in  Appendix  E.  A  complete  list  of 
survey  participants  can  be  found  in  Appendix  F. 

The  advanced  tools  identified  during  the  preceding  tasks  were  taxonomized  during  Task  3. 
The  purpose  of  this  task  was  to  organize  the  identified  tools  in  a  manner  conducive  to  identification 
of  the  features  relevant  to  their  state  of  development  and  utility.  To  facilitate  the  retrieval  of 
information,  all  tools  were  entered  into  a  data  base.  The  tool  taxonomy  used  in  development  of  the 
data  base  consists  of  20  different  fields  used  to  describe  the  tools  capabilities  and  limitations. 
Included  in  the  taxonomy  is  a  description  of  the  tool,  and  an  eight  point  classification  scheme. 
Tools  which  can  be  used  for  aviation  related  research  have  been  appropriately  identified.  A  more 
thorough  description  of  the  classification  is  provided  in  Section  2.3.  Appendix  A  contains  a  hard 
copy  printout  of  the  data  base.  A  user's  guide  to  facilitate  employment  of  the  data  base  is  presented 
in  Appendix  D.  The  classification  of  the  individual  tools  has  been  printed  out  separately,  and  is 
included  in  Appendix  B,  with  Appendix  c  presenting  an  assessment  of  the  costs  associated  with  a 
tool's  use. 

In  Task  4,  a  follow-up  telephone  survey  was  initiated.  The  purpose  of  this  survey  was  to 
solicit  clarifying  information  from  the  earlier  respondents,  and  to  query  military  users  regarding  the 
types  of  advanced  tools  they  would  like  to  see  developed.  Information  was  also  solicited  on  the 
trade-off  criteria  to  be  applied  in  Task  5  to  facilitate  the  tool  selection  process. 

In  the  fifth  and  final  task,  performance  trade-off  criteria  were  applied  to  each  advanced  tool 
listed  in  the  data  base.  The  objective  of  this  task  was  to  identify  the  most  cost  effective  tools  that 
are  adaptable  to  military  research  needs.  The  results  of  this  trade-off  process  are  presented  in 
Section  2.5. 


2.0  APPROACH 


The  objective  of  Task  1,  Literature  Review,  was  to  identify  the  traditional  and  advanced 
human  factors  tools  that  are  presently  in  use  by  HFE  practitioners.  Since  the  intent  of  this  contract 
was  to  identify  the  advanced  HFE  tools  that  are  currently  available,  the  use  of  traditional  tools  was 
relegated  to  a  secondary  role.  For  the  purpose  of  this  study,  traditional  tools  are  defined  as 
instruments  or  techniques  which  essentially  require  manual  data  entry  and/or  manipulation  (e.g., 
machinist's  ruler,  time  line  analysis,  function  allocation  and  sound  pressure  level  meter). 
Advanced  tools  are  computer  based  applications  (e.g.,  man-machine  simulation  models). 

As  previously  stated  in  Section  1.2,  the  research  conducted  during  the  course  of  this  contract 
was  intended  to  support  the  initiatives  of  the  MANPRINT  process.  Since  earlier  work  had  been 
performed  for  MANPRINT  to  identify  models  and  data  bases  that  could  be  used  as  tools  within  the 
areas  of  MPT,  SS,  and  HHA,  these  tools  and  domain  areas  were  excluded  from  review.  Also 
excluded  from  the  definition  of  tools  are  generic  methods  and  techniques  which  have  not  been 
proceduralized  or  modeled  (e.g.,  link  analysis,  function  analysis).  The  literature  survey,  therefore, 
focused  almost  exclusively  on  computer  software  which  would  fall  under  the  aegis  of  HFE. 

2.1.2  METHOD 

The  initial  step  toward  HFE  tool  identification  involved  a  review  of  existing  in-house 
documentation.  A  survey  of  Carlow  Associates  library  resulted  in  the  identification  of  several 
technical  reports  and  journal  articles  which  discussed  tool  usage.  References  in  these  resources 
served  as  a  stepping  stone  to  a  more  advanced  search  of  local  university  libraries.  The  school 
libraries  that  were  accessed  in  this  search  included: 


•  George  Mason  University 

•  George  Washington  University 

•  The  American  University 

•  Catholic  University 

•  Virginia  Polytechnic  Institute  and  State  University. 

Perusal  of  the  documents  gathered  during  the  manual  data  collection  method  indicated  that  a  more 
rigorous  search  of  the  HFE  literature  would  be  required.  A  subsequent  automated  search  was 
initiated  of  the  human  engineering  literature  pertinent  to  available  HFE  technologies.  Lockheed's 
online  DIALOG  Information  Retrieval  Service  was  selected,  serving  as  a  repository  for  over  170 
different  data  bases.  Of  the  data  bases  searched,  six  proved  especially  relevant,  providing 
worldwide  coverage  of  the  journal  literature,  publications  of  professional  societies,  periodicals, 


papers  from  conference  proceedings,  as  well  as  selected  government  reports  and  articles.  These 
data  bases  included: 

•  NTIS 

•  INSPEC 

•  SCISEARCH 

•  COMPENDEX 

•  PSYCHINFO 

•  Engineering  Meetings. 

The  search  was  limited  primarily  to  the  psychological,  engineering  and  computer  science 
literature.  Topic  areas  included,  but  were  not  limited  to,  the  following: 

•  Human  Factors  Engineering 

•  Engineering  Psychology 

•  Tools 

•  Instruments 

•  Technologies 

•  Devices 

•  Man/Machine  Interface 

•  Soldier/Machine  Interface 

•  User/Computer  Interface 

•  Research 

•  Development 

«  Test 

•  Evaluation. 

Document  titles  and/or  abstracts  were  requested  on-line,  and  all  promising  sources  were 
ordered.  When  the  literature  arrived,  it  was  examined  for  data  relevant  to  the  scope  of  the  review 
effort. 

2.1.3  RESULTS 

Although  the  search  resulted  in  literally  hundreds  of  documents,  a  core  of  71  references  were 
found  to  be  most  relevant.  These  source  documents  have  been  included  in  the  Bibliography  at  the 
end  of  this  report,  and  may  be  consulted  directly  by  the  reader  requiring  further  information  or 
clarification  on  a  particular  tool. 


Due  to  the  speed  of  recent  technological  advances,  and  the  degree  to  which  the  effects  may  be 
reflected  in  the  design  and  use  of  the  man/machine  interface,  gaps  in  the  knowledge  base  were 
expected  in  the  published  literature.  For  this  reason,  a  separate  survey  was  initiated  to  compliment 


the  literature  review.  The  objective  of  the  tool  survey  was  to  identify  those  tools  that  are  most 
frequently  utilized  by  HFE  engineers  in  the  day-to-day  conduct  of  their  jobs,  together  with  any 
ongoing  tool  development  efforts. 

2.2.2  METHOD 

A  questionnaire  consisting  of  16  tool  related  questions  was  mailed  to  283  human  factors 
practitioners  across  the  United  States,  together  with  a  self  addressed  stamped  envelope.  Names  for 
the  survey  participants  were  selected  primarily  from  the  May  1986  Directory  of  Researchers  for 
Human  Research  and  Development  Projects.  This  publication  is  a  Defense  Technical  Information 
Center  (DTIC)  document  produced  by  the  Manpower  and  Training  Research  Information  System 
(MATRIS)  office.  The  document  provides  a  list  of  individuals  who  perform  and/or  manage 
people-related  research  and  development  projects  for  the  Department  of  Defense  (DoD).  A 
secondary  source  for  names  was  the  Human  Factors  Society  1986  Directory  and  Yearbook.  The 
Directory  served  as  the  primary  source  of  names  for  practitioners  specializing  in  aviation 
psychology  and  aviation  related  work.  A  survey  of  tool  manufacturers  was  also  conducted  in 
parallel  to  the  HFE  practitioner's  survey.  The  companies  and  individuals  associated  with  tool 
development  identified  during  the  literature  search  served  as  the  source  for  this  phase  of  the  survey. 
The  telephone  was  used  throughout  this  task,  both  as  an  initiator  and  expeditor  of  information 
retrieval. 

The  1986  Human  Factors  Society  convention  held  in  Dayton,  Ohio  served  as  another  source 
of  survey  participants.  Approximately  100  questionnaires  were  distributed  to  the  convention 
attendees.  In  an  attempt  to  attract  the  largest  number  of  participants,  the  HFE  Tools  questionnaire 
was  configured  into  a  data  base  format,  and  set  up  in  Carlow  Associates  booth  in  the  exhibitor's 
hall  of  the  convention  center.  A  computerized  slide  show  accompanied  the  automated 
questionnaire,  and  introduced  potential  participants  to  the  purpose  of  the  questionnaire.  The 
automated  questionnaire  served  as  the  source  for  25  responses. 

2.2.3  RESULTS 

Of  the  283  questionnaires  distributed  through  the  mail,  a  total  of  104  were  completed, 
yielding  a  37%  rate  of  return.  The  people  who  participated  in  the  study,  along  with  their  respective 
company  or  place  of  business  is  presented  in  Appendix  F. 

Of  the  responses,  71%  indicated  that  they  had  been  involved  in  the  development  of  human 
factors  tools.  The  responses  were  equally  split  as  to  those  who  had  developed  traditional  tools  and 
those  who  played  a  role  in  the  development  of  advanced  tools.  Traditional  tools  were  found  to  be 
favored  nearly  2-to-l  over  advanced  tools.  The  main  reason  cited  for  this  preference  was  cost  and 
availability,  although  job  requirements  played  a  rather  significant  role.  If  an  HFE  specialist's  job 
did  not  require  the  use  of  advanced  technologies,  then  reliance  on  the  more  traditional  tools  would 
be  expected.  Nonetheless,  many  respondents  expressed  an  interest  in  advanced  tools.  A  general 


lack  of  information  concerning  what  advanced  tools  are  available,  however,  was  cited  as  a  major 
reason  for  their  disuse. 

Forty-six  percent  of  those  responding  have  either  developed  tools,  or  regularly  use  tools,  to 
do  aviation  related  HFE  work.  The  most  frequently  cited  traditional  tool  used  within  the  aviation 
community  was  task  analysis,  with  sensory  and  environmental  measurement  devices  such  as 
photometers,  spectroradiometers,  and  sound  pressure  level  meters  coming  in  a  close  second. 
Function  analysis  tied  for  third  place  with  HFE  data  compendiums,  which  included  standards, 
handbooks,  and  guidelines,  and  SWAT,  a  workload  evaluation  rating  scale.  The  advanced  tools 
used  most  frequently  for  aviation  related  work  were  task  modeling  simulation  tools,  with  SAINT 
being  the  most  popular.  A  dissatisfaction  was  found  to  exist  with  the  capabilities  offered  by 
existing  tools,  with  task  analysis  being  the  major  protagonist.  The  problem  with  task  analysis  lies 
in  its  labor  intensiveness.  Since  task  analysis  is  used  as  the  foundation  for  the  rest  of  the  HFE 
analysis,  a  successful  task  analysis  depends  on  a  thorough  description  of  the  tasks  and  the  task 
requirements.  Task  requirements  are  also  necessary  early  in  the  design  process,  for  representative 
mission,  mission  scenarios  and  tactical  conditions.  Often,  specific  man-machine  interactions  are 
not  available  until  late  in  the  design  process,  necessitating  frequent,  and  often  extensive  updating. 
Those  practitioners  who  use  task  analysis  would  like  to  see  the  technique  automated  to  facilitate  the 
initial  entry  and  updating  of  task  information.  Other  tools  they  would  like  to  see  developed  are  a 
better  workload  technique  and  new,  or  improved,  pilot  performance  measures.  The  ideal  tool 
would  be  a  computerized  workload  model,  and  would  include  objective  measures  of  cognitive 
workload  together  with  physiological  performance  predictors;  the  tool  should  be  integrated  into  a 
time  line,  and  produce  quantitative  output. 

Looking  at  the  tools  used  outside  of  the  aviation  specialty,  those  traditional  tools  used  most 
frequently  or  viewed  as  most  important  in  the  performance  of  HFE  related  work  were  sensory  and 
environmental  measurement  devices  such  as  those  found  in  the  HFE  T&E  Tool  Kit.  The  tools 
presently  included  in  this  kit,  along  with  those  recommended  for  use  are  presented  in  Table  1  in 
Section  2.3.3.  Task  analysis  placed  second  among  the  traditional  tools,  with  HFE  oriented 
handbooks,  guidelines  and  standards  tying  with  questionnaires  for  third  place.  The  most 
frequently  cited  advanced  tools  were  microcomputer  based  applications,  including  word 
processing,  statistical  analysis,  data  base  management,  project  planning,  and  graphics/design 
software  packages.  The  SAINT  and  MicroSAINT  task  modeling  simulation  tools  came  in  second. 
A  narrow  majority  (51%)  of  those  responding  said  they  were  satisfied  with  the  existing  capabilities 
of  the  tools  available.  The  remaining  respondents  indicated  that  the  requirements  of  their  jobs  were 
not  satisfied  by  the  features  available  for  the  tools  that  they  regularly  used,  and  thought 
improvements  were  in  order.  As  with  aviation  tools,  the  most  frequently  cited  problem  tool  was 
task  analysis,  with  61%  of  the  respondents  stating  a  need  for  improvement.  An  automated 


procedure  that  could  be  easily  modified  to  accommodate  the  demands  of  the  iterative  design  process 
would  be  universally  welcomed.  The  improvement  cited  most  frequently  which  could  be  made  to 
the  advanced  tools  SAINT  and  MicroSAINT  is  the  addition  of  a  graphics  interface.  A  direct 
manipulation  interface,  similar  to  that  found  on  the  Apple  Macintosh  computer,  would  immensely 
facilitate  data  entry. 

The  survey  identified  a  consensus  within  the  HFE  community  of  the  need  for  new,  more 
advanced  tools.  Over  88%  of  those  responding  felt  that  more  computerized  tools  would  be  a  boon 
to  the  HFE  profession.  The  two  most  frequently  requested  tools  were  for  data  bases  containing 
detailed  design  and  human  performance  information  (i.e.,  HFE  engineering  standards,  principles, 
performance  criteria,  and  guidelines)  and  computerized  workload  prediction  tools.  The  next  most 
frequently  requested  tools  included  expert  systems,  automated  task  analysis  programs,  and 
computer  aided  design  (CAD)  programs.  When  asked  if  they  would  be  interested  in  seeing  more 
advanced  tools  developed  for  use  on  the  desk  top  microcomputer,  82%  responded  positively. 
Again,  HFE  data  base  compendiums  containing  performance  criteria,  design  criteria  and  guidelines 
were  the  tools  of  choice.  Automated  task  analysis  programs  integrated  with  human  performance 
data  was  the  second  most  popular  tool  of  choice,  with  workstation  CAD,  anthropometric 
man-model  programs  and  user/computer  interface  (UCI)  rapid  prototyping  software  all  tied  for 
third  place. 

The  typical  response  when  asked  what  existing  main  frame  or  minicomputer  tools  should  be 
modified  for  use  on  a  microcomputer  was  "all  of  them."  When  asked  to  be  more  specific,  the  tools 
cited  most  frequently  were  SAINT  (which  has  already  been  adapted  to  the  microcomputer  as 
MicroSAINT,  by  Micro  Analysis  and  Design,  Inc.,  under  a  contract  with  the  Army  Medical 
Research  and  Development  Command)  and  HOS  IV,  followed  by  the  development  of  micro-based, 
HFE  oriented  expert  systems  (ES).  The  remaining  tools  requested  for  modification  included: 

•  CAFES  (with  a  "Macintosh  like"  interface) 

•  SAMMIE  (for  the  Apple  Macintosh) 

•  MIST  (an  MP&T  tool) 

•  GENSAW 

•  Designer’s  Associate 

•  BEMOD 

•  MicroSAINT  (with  a  direct  manipulation  interface) 

•  CAR. 

These  tools  are  fully  described  in  Appendix  A. 


2.3.1 


The  objective  of  the  HFE  tools  taxonomy  task  was  to  develop  an  organizational  framework 
for  the  tools  identified  during  the  literature  review  and  survey,  and  to  provide  a  method  by  which 
important  features  relevant  to  a  tool's  state  of  development  and  utility  could  be  quickly  accessed. 
2.3.2  METHOD 

The  approach  taken  to  meet  the  objectives  of  this  task  was  the  creation  of  an  advanced  tools 
data  base  management  system  (DBMS).  Such  a  system  was  deemed  necessary  since  an  objective 
was  to  provide  an  efficient  means  of  searching  for  and  retrieving  information.  A  corollary  benefit 
of  entering  the  results  of  the  tools  survey  into  a  structured  DBMS  is  that  it  provides  a  mechanism 
for  easy  expansion.  Updating  the  final  product  as  new  tools  hit  the  market,  or  as  additional 
information  is  received,  will  be  much  simpler,  and  therefore  more  likely  to  be  done.  Additionally, 
users  will  be  more  likely  to  take  advantage  of  the  data  base  if  it  represents  an  up-to-date  reflection 
of  the  availability  of  state-of-the-art  HFE  tools. 

The  system  selected  to  create  the  data  base  was  the  Double  Helix  program  by  Odesta 
Corporation.  The  data  base,  as  configured,  runs  on  a  Macintosh  Plus  microcomputer  and  requires 
5 12  Kb  of  RAM  and  two  800  Kb  disk  drives.  The  taxonomy  used  in  defining  the  advanced  tools 
capabilities  and  limitations  consists  of  20  discrete  fields  of  information.  A  description  of  these 
fields  follows: 

Tool  Name  -  The  full  name  for  the  tool  along  with  the  more  familiar  acronym  or  abbreviation, 
where  applicable. 

Record  No.  -  A  unique  numeric  identifier  used  to  facilitate  the  retrieval  of  a  specific  tool  from  the 
data  base. 

Description  -  A  narrative  description  of  the  tool  synthesized  from  information  obtained  during 
the  literature  review,  practitioner  survey,  and  follow-up  survey. 

Input  Requirements  -  Those  features  which  must  be  known  or  identified  before  the  tool  can 
be  used  effectively. 

Output  Requirements  -  The  expected  results  from  a  successful  application  of  the  tool. 
Resource  Requirements  -  The  hardware  and/or  software  required  in  order  to  use  the  tool. 
Advantages  -  Strengths  or  positive  features  of  a  tool  which  facilitate  its  application  or  maximize 
its  utility. 

Disadvantages  -  Drawbacks  or  negative  aspects  of  a  tool  which  thwart  its  potential. 

MAP  Phase  -  Phase(s)  of  the  materiel  acquisition  process  (MAP)  in  which  the  tool  can  be  used 
or  is  typically  used  to  derive  its  maximum  effectiveness.  These  phases  include: 

Preconceptual  (PRE-CON) 

Concept  Exploration  (CON) 
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Demonstration  and  Validation  (D&V) 

Full  Scale  Development  (FSD) 

Production  and  Deployment  (P&D) 

Product  Improvement  (PI). 

Activity  -  The  human  factors  engineering  activity  area  under  which  the  tool  falls.  Activity  areas 
include: 

Design 

Analysis 

Test  and  Evaluation  (T&E  ). 

Tool  Type  -  The  application  area  under  which  the  tool  falls,  in  other  words,  what  the  tool  is. 
The  different  kinds  or  types  of  tools  include: 


Functional  model 
Task  model 
Task  model,  workload 
Task  model,  time  line 
Task  model,  performance 
Data  access 


Man  model 
Man  model,  graphic 
Man  model,  CAD 
Man  model,  animation 
Man  model,  crash  simulation 
Man  model,  simulation 
Data  base 

Information  flow  model 


Workspace  model  -  Information  flow  model 

Graphic  -  Information  model 

Family  of  tools  -  Rapid  prototyping 

Rating  scale  -  Expert  system 

Reliability  model  -  User  Interface  Management  System  (UIMS) 

Logistics  model 

Tool  Class  -  The  specific  HFE  classification  under  its  general  area  of  application;  that  is,  what 
the  tool  does.  Tool  class  may  be  viewed  as  a  subset  of  tool  type,  and  generally  includes  a 
combination  of  the  classes  listed  below: 


Panel  design/evaluation 
Performance  analysis 
Workload  analysis/evaluation 
T&E 

Maintenance  analysis 
UCI  design 
Comparability  analysis 
Display  evaluation 
Functional  analysis 


Front  end  analysis  (FEA) 

Task  modeling 
Workstation  design 
Procedures 

Reach/vision  analysis/envelope 
Facility  design 
Task  analysis 
Procedures  design 
Function  allocation 


Crew  station  design 
Simulation 


Workspace  layout 
Task  allocation 
Life  support 
Robotics,  reach 


Force/torque  -  Life  support 

Strength  -  Robotics,  reach 

Management  -  Robotics 

Training  analysis 

Tool  Role  -  Presents  examples  of  how  the  tool  has  been  used  in  the  past  or  how  it  can  be  used 
within  a  given  HFE  context  Role  should  be  considered  a  combination  of  tool  type  and  class. 
Application  -  The  tools  orientation,  that  is,  its  role  as  being  either  a  traditional  tool  with  a 
manual,  generic  or  data  bent,  or  an  advanced  tool  running  on  a  main  frame,  minicomputer,  or  desk 
top  microcomputer.  For  this  phase  of  the  contract,  all  tools  included  in  the  DBMS  are  advanced 
applications.  This  field  has  been  added  in  anticipation  of  updating  the  system  to  include  traditional 
HFE  tools  (e.g.,  hand  held  and  generic  proceduralized  tools),  and  eventually  tools  which  fall 
under  other  MANPRINT  disciplines  (i.e.,  HHA,  MP&T,  SS). 

Status  -  Refers  to  the  tools  accessibility.  Under  status,  the  tool  is  classified  as: 

Conceptual:  not  presently  available  for  application. 

Prototype:  available  but  does  not  include  all  planned  features,  or  may  not  have  been  fully 
verified  and/or  validated  (e.g.,  tools  in  the  beta  stage  of  testing). 

Operational:  fully  developed  and  available. 

Cost  -  The  absolute  cost  of  the  tool  has  been  included  if  the  information  was  available. 

Aviation  Related  -  Tools  used  specifically  for  aviation  related  work  or  which  can  be  applied  to 
aviation  type  problems  have  been  identified  as  such. 

Source  -  Identifies  the  tool  developer,  manufacturer  or  source  from  which  the  tool  can  be 
obtained. 

References  -  Cites  the  reference  materiel  or  personal  conversations  used  in  compiling 
information  on  the  tool.  Complete  references  can  be  found  in  the  reports  bibliography. 

Comments  -  A  catchall  field  designed  to  capture  information  which  docs  not  belong  in  any  of  the 
other  fields.  For  example,  proprietary  tools  are  noted  within  this  field. 

Menus  have  been  added  to  the  data  base  to  allow  the  user  to  quickly  search  those  areas 
considered  to  be  of  primary  importance.  These  areas  include  the  six  phases  of  the  materiel 
acquisition  process,  the  three  HFE  activity  areas,  and  those  tools  related  to  aviation.  The  remaining 
categorization  fields  and  categorization  levels  can  all  be  used,  either  singularly  or  in  combination,  to 
query  a  specific  area  of  interest  associated  with  advanced  tool  use.  For  example,  all  man  model  or 
workspace  layout  related  tools  can  be  identified  quickly  by  using  the  Query  function  for  Tool  Type 
and  Tool  Class,  respectively. 
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Phase  I  efforts  have  resulted  in  the  identification  and  documentation  of  1 13  advanced  human 
factors  engineering  tools,  88  of  which  were  determined  to  have  enough  descriptive  information  to 
be  included  in  the  data  base.  A  narrative  summary  which  describes  the  purpose  of  each  tool,  along 
with  all  other  related  information  which  is  found  in  the  data  base  has  been  included  in  Appendix  A. 
Given  the  time  and  money  constraints  imposed  on  the  contract,  every  effort  was  made  to  ensure 
that  the  descriptive  information  contained  in  the  data  fields  under  each  tool  was  as  exhaustive  as 
possible.  At  times  however,  no  information  could  be  found  on  some  of  these  areas.  In  such 
circumstances,  the  phrase  "None  Identified"  appears  in  the  data  field.  A  complete  listing  of  all  the 
tools  contained  in  the  data  base  is  presented  in  Table  1. 

The  traditional  tools  identified  during  the  course  of  this  contract  have  not  been  included  in  the 
data  base.  The  most  popular  (i.e.,  widely  used)  and  frequently  cited  traditional  tools  with 
application  to  Army  T&E  activities  have  been  sorted  into  application  areas,  and  identified  along 
with  the  name  of  the  tools  manufacturer.  This  list  of  HFE  tools  are  those  recommended  to  be  most 
advantageous  in  satisfying  Army  objectives.  Their  use  and  application  will  be  fully  described  in  a 
video  tape  training  program  under  a  different  Army  contract  performed  by  Carlow  Associates  for 
TECOM.  The  complete  list  of  traditional  tools,  along  with  their  related  accessories,  can  be  found  in 
Table  2. 

Other  advanced  tools  with  HFE  applicability  were  identified  but  do  not  appear  in  Appendix 
A,  either  because  of  limited  information  availability  or  because  their  existence  became  known  too 
late  in  the  course  of  the  contract  for  inclusion  in  the  data  base.  These  tools  are  briefly  summarized 
below. 

*  Available  Motions  Inventory  (AMI)  -  A  system  for  measuring  human  physical  ability 
based  on  components  of  industrial  manual  tasks.  The  AMI  consists  of  short  cycle  tasks 
measuring  specific  functional  output. 

*  Operator  Station  Design  System  (QSDS1  -  A  stand  alone  minicomputer  based 
workstation  used  to  design  panel  layouts,  assess  reach  and  vision  envelopes,  determine 
physical  interference  constraints  and  fit  problems  early  in  the  design  phase,  and  study 
design  applications  as  a  function  of  anthropometric  and  mission  requirements.  The 
system  uses  the  PLAID  and  CAR  programs,  and  relies  on  a  data  base  which  consists  of 
Shuttle  Transportation  System  orbitercrew  compartment  data,  orbiter  payload  bay  and 
remote  manipulator  data,  and  various  anthropometric  populations. 

*  Force  Man  -  A  3-D  man  modeling  program  for  computing  force  capabilities  as  a  function 
of  equipment  mass,  body  position  and  gravitational  force  T  he  man  model  consists  ol 
19  links  and  17  joints. 
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•  Lift  Man  -  A  man  modeling  program  used  to  predict  strength  capabilities  in  a  one-G 
environment. 

•  MTM  Man  -  A  man  model  program  developed  for  the  design  of  manual  work  stations. 
The  spatial  coordinates  of  torso  and  upper  extremity  joints  are  computed  based  on  limb 
lengths,  chair  geometry,  and  a  sequence  of  hand  locations  and  orientations. 

•  BULGAR  -  A  man  model  program  that  employs  a  13  joint,  14  link  model.  The  program 
calculates  the  location  of  body  segments  from  anthropometric  and  joint  angle  data. 

•  TOROIJEMAN  -  A  man  model  program  that  computes  the  static  forces  and  torques  at  6 
body  joints.  After  entering  joint  angles,  external  force  characteristics,  and 
anthropometric  variables,  the  program  displays  force  vectors  on  a  2-D  graphical  man 
model. 

•  S  AS  -  An  animated  man  model  program  which  uses  3-D  anatomically  correct  human 
skeletons.  The  human  figure  movements  are  executed  procedurally  using  a  hierarchical 
organization  of  control  programs.  Tasks  are  broken  down  into  sets  of  movement  skills. 
Each  skill  is  implemented  by  a  programmed  set  of  procedures  which  evoke  a  set  of 
movement  primitives.  The  program  uses  motor  procedures  for  standing,  broad  jump 
and  various  stages  of  locomotion  over  level,  unobstructed  terrain. 

•  Business  Filevision  -  A  graphic  information  management  system  that  integrates  a  filing 
system  and  drawing  system  with  a  report  generator.  Information  can  be  represented  in 
pictures,  words  or  numbers.  The  program  contains  built-in  statistical  capability,  and  is 
capable  of  sorting  and  analyzing  extensive  data  which  is  embedded  within  smart 
drawings.  Can  also  be  used  as  a  rapid  prototyping  system  to  mock-up  user-computer 
interfaces.  (Telos  Software) 

•  Enhanced  Graphics  Adapter  -  Generates  graphical  operational  sequence  diagrams. 
Government  owned  (Naval  Ocean  Systems  Center). 

•  Network  Management  Tool  -  Organizes  and  arranges  characteristics  of  task  networks 
for  structuring  function  flow  block  diagrams.  (Boeing  Aerospace) 

•  MAP  -  A  PC  based  tool  used  to  assess  performance  effectiveness  based  on  subjective 
measures  (Army  Research  Institute). 

Some  advanced  tools  were  identified  during  the  literature  review  for  which  no  definitive 
information  was  available.  Rather  than  dropping  these  tools  entirely  from  the  report,  they  were 
elected  for  inclusion  in  hopes  that  acknowledgment  of  their  existence  would  in  some  way  benefit 
readers  who  may  be  familiar  with  them.  These  tools  include: 

•  Automated  Sequence  Plotter  (ASP) 

•  MONTE 

•  Fourth  Man 


•  Job  Assessment  Software  System  (JASS) 

•  Task-Time  Multiplan 

•  Human  Performance  Modeling  Language 

•  Integrated  Ergonomics  Model 

•  On-line  Critical  Incident  Tool 

•  GREAT 

•  W  INDEX 

•  Computerized  WAM 

•  Computer  Model  of  Body  Motion 
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Table  1.  Advanced  Human  Factors  Engineering  Tools 
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ADM  (A  Dialog  Manager) 

ASSET  (Acquisition  of  Supportable  Systems  Evaluation  Technology) 

ATB  Model 

BEMOD  (Behavior  Modification) 

BIOMAN 

BUFORD 

CADAM/ADAM  (Anthropometric  Design-Aided  Mannequin)  &  EVE  (Ergonomic  Value 
CADET  (Computer  Aided  Design  and  Evaluation  Techniques) 

CAFES  (Computer  Aided  Function  Allocation  Evaluation  System) 

CAFES-CAD  (Computer  Aided  Function  Allocation  Evaluation  System-Computer  Aided 
CALSPAN  3D  CVS 

CAPABLE  (Controls  And  Panel  Arrangement  By  Logical  Evaluation) 

CAPE  (Computer  Accommodated  Percentage  Evaluation) 

CAPRA  (Computer  Aided  Probabilistic  Risk  Assessment) 

CAR  (Crewstation  Assessment  of  Reach) 

CGE/BOEMAN  (Crewstation  Geometry  Evaluation/Boeman) 

CHESS  (Crew  Human  Engineering  Software  System) 

CINCI  KID 
COM-GEOM 

COMBIMAN  (Computerized  Biomechanical  Man-Model) 

CORELAP  (Computerized  Relationship  Layout  Planning) 

COUSIN  (Cooperative  USer  INterface) 

CRAFT  (Computerized  Relative  Allocation  of  Facilities) 

CRAWL 
CREW  CHIEF 

CUBITS  (Criticality/Utilization/Bits  of  Information) 

CVAS  (CrewstatL  Vision  Analysis  System) 

CYBERMAN 

DAP  (Display  Analysis  Program) 

DART  (Data  Analysis  and  Retrieval  Technique) 

Designer's  Associate 

DMS  (Data  Management  System) 

ERGOMAN 

ERGONOGR  API  IY 

ETAS  (Essex  Training  Analysis  System) 

FAM  (Functional  Allocation  Model) 
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Table  1.  (cont'd.) 


15  FLAIR  (Functional  Language  Articulated  Interactive  Resource) 

87  Function  Allocation  Decision  Aid 

67  GENSAW  (Generic  Systems  Analyst  Workstation) 

88  GEOMOD  (Geometric  Modeling  Tool) 

59  Graphical  Marionette 

30  GRASP  (Graphical  Robot  Applications  Simulation  Package) 

3  HECAD  (Human  Engineering  Computer-Aided  Design) 

29  HF-ROBOTEX  (Human  Factors -Robotics  Expert  System) 

69  HIMS  (Helicopter  Inflight  Monitoring  System)  II 
36  HOS  (Human  Operator  Simulator) 

60  HSRI  Models 

74  ICAM  (Interactive  Control  Assessment  Methodology) 

32  KADD  (Knowledge  Aided  Display  Design) 

82  Knowledge-based  HFE  Document  Preparation  System 

1 6  LA YGEN  (LAYout  GENerator) 

39  MAWADES  (Multi-man  MAchine  Work  Area  Design  Evaluation  System) 
24  MENULAY 

14  Micro  SAINT  (Micro-Systems  Analysis  of  Integrated  Networks  of  Tasks) 
86  MOPSIE  (Multiple  Operator  Parallel  Systems  Evaluation) 

61  NUDES 

8  ORACLE  (Operators  Research  and  Critical  Link  Evaluation) 

43  OSDS  (Operator  Station  Design  System) 

49  OWLES  (Operator  Workload  Evaluation  System) 

44  PLAID  (Panel  Layout  Automated  Interactive  Design) 

81  POSIT 

85  PROFILE 

5  SAINT  (Systems  Analysis  of  Integrated  Networks  of  Tasks)  I&II 
12  SAMMIE  (System  for  Aiding  Man-Machine  Interaction  Evaluation) 

63  SFU  Model 
27  SIEGEL-WOLF 

83  SIMKIT 


62  SIMULA/PROMETHEUS 

7  SIMWAM  (Simulation  for  Workload  Assessment  and  Modeling) 
72  SLAM  II  (Simulation  Language  for  Alternative  Modeling) 

71  SPRINGMAN 


17  STELLA  (Structural  Thinking,  Experimental  learning  Laboratory  with  Animation) 
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Tabic  1.  (cont'd.) 


64  STICKMAN 

48  SWAT  (Subjective  Workload  Assessment  Technique) 

22  TASCO  (Timebased  Analysis  of  Significant  Coordinated  Operations) 
78  TEMPUS 

4  TEPPS  (Technique  for  Establishing  Personnel  Performance  Standards) 
1 1  TLA-1  (TimeLine  Analysis  Program-Model  1) 

9  TREES  (Tree  Structured  Data) 

65  TTI  Models 

10  TX-105  (Operator/Crew  Workload  Assessment  Technique  TX-105) 

66  UCIN 

35  WAM  (Workload  Assessment  Model) 

42  WOLAG  (Workstation  Layout  Generator) 

2  WOLAP  (Workspace  Optimization  and  Layout  Planning) 

41  WORG  (Workspace  ORGanizer) 

40  WOSTAS  (Workstation  Assessor) 

70  ZITA  (Zero  Input  Tracking  Analyzer) 
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Table  2.  Recommended  HFE  T&E  Tools  and  Accessories 


Photometer,  Model  FC-200,  Photo  Research  Corporation. 

Photometer  and  readout/control  unit 
Probe 

Cosine -corrected  receptor 
Attenuator  slide 
Photogrid 
Zeroing  slide 

LiteMate/Spotmate,  Model  500,  Photo  Research  Corporation. 

LiteMate  photometer 
SpotMate  attachment 
Zeroing  disk 

Cosine -corrected  receptor 
Spare  battery 
Carrying  case 
MicroReader  probe 
Fiber  optics  probe 
Extension  tubes 

Pritchard  photometer.  Model  1980EMX,  Photo  Research  Corporation. 
Photometer  and  readout/control  unit 
Optical  head 
Standard  lens 
Close-up  lens 
Portable  AC  power  supply 
20  foot  extension  cable 
Pan/tilt  head 
Carrying  cases 


a 


Noise 


Sound  level  meter,  Model  B&K  2209,  Bruel  &  Kjaer. 

-  Octave  filter  set,  Model  B&K  1613,  Bruel  &  Kjaer. 

Sound  level  meter  -  Model  B&K  2230,  Bruel  &  Kjaer.  Replacing  B&K  during  phaseout. 

-  Octave  filter  set,  Model  B&K  1625,  Bruel  &  Kjaer. 

Tape  recorder,  Model  B&K  7006,  Bruel  &  Kjaer. 

FM  unit,  Model  B&K  ZM  0053,  Bruel  &  Kjaer. 

Compander  unit,  Model  B&K  ZM  0054,  Bruel  &  Kjaer. 

Digital  frequency  analyzer,  Model  B&K  2131,  Bruel  &  Kjaer. 

Connector  cable,  Model  B&K  AO  0194  or  AO  0264,  Bruel  &  Kjaer. 

Digital  oscilloscope,  Model  4094,  Nicolet. 

Related  microphones  and  accessories 

1/2  inch  condenser  microphone,  Model  B&K  4165,  Bruel  &  Kjaer. 

1/2  inch  condenser  microphone,  Model  B&K  4134,  Bruel  &  Kjaer. 

1/4  inch  condenser  microphone,  B&K  4136,  Model  Bruel  &  Kjaer. 

Microphone  extension  cable,  B&K  AO  0027,  Model  Bruel  &  Kjaer. 
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Table  2.  (cont'd.) 

1/4  -1/2  inch  microphone  adaptor,  Model  B&K  UA  0035,  Bruel  &  Kjaer. 
Windscreen  for  1/2  inch  microphones,  Model  B&K  UA  0237,  Bruel  &  Kjaer. 
Pistonphone  calibrator,  Model  B&K  4220,  Bruel  &  Kjaer. 

Preamplifier  for  1/2  inch  microphones,  Model  B&K  2642,  Bruel  &  Kjaer. 

Power  supply  for  battery  pre-amplifier  operation,  Model  B&K  280,  Bruel  &  Kjaer  . 
Power  supply  for  AC  pre-amplifier  operation,  Model  B&K  2810,  Bruel  &  Kjaer. 
Extension  rod,  Model  B&K  UA  0196,  Bruel  &  Kjaer. 

Connecting  bar,  Model  B&K  JP  0400,  Bruel  &  Kjaer. 

Power  supply,  Model  B&K  ZG  0199,  Bruel  &  Kjaer. 

DIN  cable  (7  core),  Model  B&K  AQ  0035,  Bruel  &  Kjaer. 

Batteiy  pack.  Model  B&K  ZG  0146,  Bruel  &  Kjaer. 

12  Volt  automobile  battery. 

Spire  3.15  amp  fuses,  Model  B&K  VF  0019,  Bruel  &  Kjaer. 

Extra  recording  tape  (1/4  inch),  Model  B&K  QR  1003,  Bruel  &  Kjaer. 


Force  Push-Pull  Gauges,  2,5,50  lb.,  Chatillon. 

Dial  Torque  Gauges,  Models  TG-80  and  TG-160,  Chatillon. 

Attachments 

—  notched  head 

-  flat  head 

-  cone  head 

-  chisel  head 

—  hook 

—  extension  rod 

Torque  Wrenches  -  M.H.H.  (via  Mountz);  used  with  standard  square  shaft  socket  tool 
attachments  &  adaptor. 

Dial  Calipers,  Helios,  Fowler. 


Tape  Measures,  12,  20,  100  ft.,  StarretL 
Protractor  -  Tractograph. 

Digital  weight  scales,  Model  75  IT,  Sears. 


Digital  Thermometer,  Model  8502-50,  Cole-Parmer. 

Rechargeable  batteries. 

In-line  charger/  AC  adaptor. 

Immersible  probe. 

Air  temperature  probe. 

Surface  temperature  probe. 

Sling  psychrometer,  MSA  or  Taylor  1328 A. 

Aspirating  psychrometer,  Model  PP-100  or  CP- 147,  Psychro-Dyne. 
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Table  2.  (cont'd.) 


Wet  bulb  heat  stress  monitor,  Model  B&K  1219,  Bruel  &  Kjaer. 

Transducer,  Model  B&K  MM  0030  (3  each),  Bruel  &  Kjaer. 

Air  velocity  meter  (hot  wire  anemometer),  Model  441,  Kurz. 

Battery  charger. 

Probe  with  cable. 

Air  velocity  meter  (hot  wire  anemometer),  Model  W141-A,  Weather  Measure  . 
Penlight  batteries  -  eight  1.5  volt. 

Probe  with  cable. 

Anthropometry 

Anthropometer,  Siber. 

Sliding  Caliper,  Siber. 

Spreading  Caliper,  Siber. 

Goniometer,  Model  and  Manufacturer  not  established. 

Performance 

Digital  Timer,  Model  LC-MST,  Cronus. 

Event  Counter,  Perceptronics. 

Video  Tape  System 

Camera,  Model  DXC-3000  (replacement  for  JVC  G-71USJ),  Sony. 
Recorder,  Model  VO-4800,  Sony. 

Monitor,  Model  Sony  PVM-8000,  Sony. 

Connector  cables. 

Camera,  Model  600  SE,  Polaroid. 

Electronic  flash  unit,  Vivitar. 

Light  meter,  Model  Scout  2,  Gossen. 

Lenses  -  as  required;  suggest,  at  the  minimum,  a  wide  angle  lens. 
Film,  as  needed. 

35  mm  SLR  camera  -  Pentax  MX. 

Accessories  as  needed  (see  list  for  Polaroid  600  SE  above). 

Instant  camera  -  Polaroid  Spectra. 

Film  -  special  Polaroid  film  made  specifically  for  the  Spectra. 

Recording  and  Analysis 

Audio  Recorder,  Model  TMC-1 1 1  or  TC-55,  Sony. 

Programmable  Calculator,  Model  TI-59,  Texas  Instruments. 

Adaptor/  charger,  Model  AC9 131. 

Changeable  cards  for  statistical  packages. 


Table  2.  (cont  d.) 


Micro-computer  system  -  Macintosh  Plus  and  supporting  software(specific  features/ 
accessories  can  be  tailored  to  particular  requirements). 

tenance  and  Support 

Equipment  cases,  provided  with  basic  equipment. 

Tripods,  Star  D. 

Tool  kit* 

Digital  multimeter.  A  variety  of  multimeters  are  available,  both  in  analog  and  digital  formats. 
Battery  Charger.  Available  with  basic  equipment. 

Binoculars,  Bushnell. 


*Although  a  variety  of  standard  kits  are  available  "off-the-shelf',  it  is  recommended  that 
the  contents  of  tool  kits  be  assembled  according  to  specific  requirements,  i.e.,  to  support 
equipment  actually  in  inventory.  N.B.  As  new  equipment  is  added,  relevant  support  and 
maintenance  tools  should  be  acquired  simultaneously. 
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2.4.1  OBJECTIVE 

A  follow-up  telephone  survey  was  conducted  of  military  HFE  specialists  regarding  the  types 
of  advanced  tools  they  would  like  to  see  developed,  and  to  gain  insights  into  the  adaptability  of  the 
advanced  tools  in  meeting  the  Army's  R&D  and  T&E  needs.  A  secondary  objective  of  this  task 
was  to  solicit  additional  information  surrounding  a  tool's  use.  This  was  necessary  due  to  the 
unavailability  of  information  in  the  literature,  or  the  omission  of  significant  data  from  the  responses 
to  the  questionnaires.  The  third  and  Final  objective  was  to  obtain  information  from  the  practitioners 
who  have  used  the  tools  on  a  regular  basis  to  facilitate  the  tool  trade-off  process  to  be  conducted  in 
the  Fifth  and  Final  task. 

2.4.2  METHOD 

Forty-four  HFE  specialists  associated  with  the  U.S.  Military  participated  in  the  survey,  with 
75%  of  these  contacted  to  solicit  their  opinions  on  the  use  of  advanced  tools  within  the  military. 
Telephone  calls  were  made  to  interview  the  specialists  using  customized  questionnaires  tailored  to 
the  speciFic  objectives  of  the  interview  session.  For  the  most  part,  the  questions  related  to  trade-off 
criteria  concerning  the  tools  availability,  accessibility,  adaptability,  utility,  training  requirements  and 
mobility,  and  clarification  of  selected  responses  from  the  questionnaire.  The  telephone  calls  took 
place  during  the  weeks  of  December  15,  1986  through  January  12,  1987.  For  the  most  part,  the 
respondents  were  anxious  to  talk  about  the  tools  and  contributed  significantly  to  the  outcome  of  the 
survey.  The  military  specialists  contacted  were  associated  with  the  following  installations: 

•  Naval  Ocean  Systems  Center 

•  Office  of  Naval  Research 

•  Naval  Training  System  Center 

•  Navy  Personnel  Research  &  Development  Center 

•  WPAFB-Flight  Dynamics  Laboratory 

•  WPAFB-Aerospace  Medical  Research  Laboratory 

•  U.S.  Air  Force  Academy 

•  U.S.  Army  Aviation  Center-Ft.  Rucker 

•  TECOM 

•  HEL-WPAFB 

•  UEL-Aberdeen  Proving  Ground 

•  ARl-Alexandria 

•  ARI-Ft.  Bliss 

•  ARI-Ft.  1  hx>d 
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In  addition  to  the  telephone  survey,  a  day  trip  to  the  Naval  Air  Development  Center  in 
Warminster,  PA,  was  coordinated  in  an  effort  to  obtain  information  from  several  military  expens 
regarding  their  use  and  application  of  automated  HFE  tools.  At  this  time,  information  was  obtained 
on  the  advanced  tools  CAR,  CADET,  POSIT,  COMBIMAN,  CREW  CHIEF,  TEMPUS,  PLAID, 
SAMMIE,  HOS,  and  BIOMAN. 


Seventy-three  percent  of  those  military  specialists  surveyed  would  welcome  the  addition  of 
new  automated  HFE  tools.  Eighteen  percent  were  indifferent,  and  9%  firmly  communicated  that 
new  tools  were  not  necessary.  The  reasons  given  by  those  with  negative  responses  were  largely 
attributable  to  the  glut  in  the  existing  inventory  of  advanced  tools.  Reasons  given  by  military 
practitioners  which  typify  the  consensus  of  "No”  responses  include: 

•  "There  is  a  need  for  more  human  factors  engineers  to  apply  the  tools  that  are  available." 

•  "I  would  like  them  to  become  more  accurate  and  affordable." 

•  "I'm  tired  of  seeing  old  tools  being  reinvented  and  passed  off  as  new  tools." 

The  most  frequently  requested  advanced  tool  by  military  human  factors  engineers  was  for  a 
computerized  workload  prediction  tool.  The  ideal  tool  would  integrate  measures  of  cognitive 
workload  with  physiological  performance  predictors  to  yield  objective  measures  of  performance. 
The  tool  should  be  able  to  accurately  predict  workload  across  a  wide  spectrum  of  job  assignments, 
have  good  face  validity,  and  be  accepted  by  engineers.  The  tool  next  most  frequently  requested 
was  a  generic  expert  system  (ES).  An  expert  system  refers  to  a  "type”  of  advanced  tool  which  is 
based  on  a  collection  of  techniques  associated  with  artificial  intelligence  research  that  enables 
computers  to  assist  people  in  analyzing  problems  and  making  decisions.  Expert  systems  are 
computer  based  technologies  that  perform  at,  or  near,  the  level  of  a  human  expert.  Two  systems 
specifically  requested  were  an  ES  capable  of  sorting  through  voluminous  amounts  of  HFE  data  to 
solve  problems  relating  to  system  design,  and  a  system  that  can  be  used  to  select  the  appropriate 
HFE  tools  and  technologies  that  are  available  to  the  HFE  practitioner  given  a  mission  objective 
while  considering  constraints  on  the  design  or  development  process. 

The  tool  cited  with  the  best  potential  for  application  on  a  desk  top  microcomputer  was  task 
analysis.  An  automated  task  analysis  program  capable  of  systematically  grouping  and  rapidly 
sorting  through  a  data  base  of  tasks  and  subtasks  requirements  and  interdependencies  would  be 
welcomed  by  HFE  practitioners  both  within  and  outside  the  military.  The  development  of  such  a 
tool  would  minimize  the  labor  intensiveness  involved  in  the  constant  updating  of  task  information 
as  it  changes  during  the  iterative  system  development  process.  The  tools  next  most  frequently 
requested  by  military  human  factors  engineers  for  development  on  a  microcomputer  included 
HFE  data  base  compendiums  and  UCI  rapid  prototyping  software.  Other  popular  choices  included 
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CAD  programs,  anthropometric  man  models,  and  an  automated  operational  sequence  diagram 
(OSD)  application. 

When  quered  about  what  existing  minicomputer  or  main  frame  tools  should  be  modified  to 
run  on  a  microcomputer,  the  typical  response  was  SAINT.  As  previously  mentioned  in  Section 
2.2.3,  SAINT  has  already  been  adapted  to  run  on  IBM  PC  compatible  machines  under  the  name  of 
MicroSAINT.  The  remaining  tools  identified  include: 

•  BEMOD 

•  CAFES 

•  Designer's  Associate 

•  SAMMIE 

•  GENSAW 

•  HOS  IV 

•  MIST  (an  MP&T  tool). 

2.5  Task  5-  Trade-off  Criteria 

2.5.1  OBJECTIVE 

The  objective  of  the  fifth  and  final  task  was  to  recommend  to  the  Army  a  set  of  advanced 
tools  that  could  be  used  to  facilitate  HFE  soldier-machine  interface  research  based  on  the  tools 
performance  characteristics  and  requirements  in  meeting  system  objectives.  A  corollary  objective 
was  to  base  these  considerations  on  cost,  where  possible,  to  determine  if  the  anticipated  gains  in 
performance  could  be  used  to  justify  the  cost  of  developing  or  procuring  a  new  tool. 

2.5.2  METHOD 

'Hie  first  step  taken  in  selecting  tools  was  identification  of  the  trade-off  criteria  that  would 
ultimately  be  used  in  classification  of  the  tool.  Literature  on  trade-off  analysis  was  reviewed, 
particularly  as  applicable  to  software  and  large  system  design.  Chubb  (1987)  was  particularly 
helpful  in  the  area  of  human  performance  modeling  and  simulation  languages.  DeGreene  (1970) 
and  Meister  (1971)  provided  general  advice  on  the  process  of  conducting  trade-off  analyses.  In 
order  to  keep  the  process  as  simple  as  possible,  yet  maintain  the  robustness  necessary  for  a  useful 
trade-off,  the  number  of  criteria  had  to  be  kept  at  a  manageable  level,  yet  at  the  same  time  remain 
pertinent.  Ultimately,  six  trade-off  factors  were  selected  which  were  deemed  relevant  to  the  task. 
These  criteria  include  the: 

•  Availability-  of  a  tool  to  the  general  public.  Tools  were  classified  as  being  either 
company  proprietary,  and  therefore  unavailable  for  general  use,  or  commercially 
available  to  the  II EE  market. 


Accessibility-  of  commercial  tools.  Tools  were  classified  as  a)  conceptual  in  their  state 
of  development  and  therefore  not  available  in  the  near  future  for  application;  b)  in  the 


prototype  stage  of  development,  and  therefore  available,  but  lacking  certain  features,  or 
not  fully  verified  and/or  validated;  or  c)  operational,  fully  developed  and  available. 

•  Adaptability-  of  the  software  to  other  computers.  Tools  exhibiting  good  adaptability 
exist  in  multiple  versions,  and  therefore  are  capable  of  running  on  more  than  one 
machine.  Self-contained  computing  mechanisms  exhibit  good  adaptability. 

•  Utility-  worth,  or  value  of  a  tool  as  judged  by  its  ability  to  satisfy  the  requirements  or 
capabilities  identified  as  important  by  the  questionnaire  respondents. 

•  Training-  required  before  the  tool  can  be  used,  or  how  easily  the  tool  is  learned. 

•  Mobility-  or  portability  of  the  hardware  on  which  the  software  runs.  Microcomputers 
which  can  be  taken  into  the  field  were  judged  better  than  mainframes  in  meeting  certain 
military  objectives. 

The  next  step  involved  in  the  trade-off  was  to  weight  the  above  criteria,  and  build  a  decision 
tree  (Figure  3)  around  the  importance  assigned  to  the  criteria  on  which  the  tools  could  be  judged. 
The  criterion  assigned  the  most  weight  was  encountered  first  in  the  tree,  with  the  weights  for  the 
remaining  criteria  falling  off  the  further  one  passed  into  the  tree.  The  importance  of  the  criteria  is 
therefore  reflected  in  the  sequence  in  which  they  appear  in  the  tree.  A  Tool  Categorization  Form 
was  filled  out  for  each  tool  in  the  data  base  to  reflect  the  ability  of  the  tool  in  satisfying  the  trade-off 
objectives.  This  form  is  presented  in  Figure  2.  The  results  of  the  completed  Tool  Categorization 
Form  were  next  transferred  to  the  Trade-off  Criteria  Decision  Tree  Form,  with  the  final  destination 
node  highlighted  and  the  respective  encircled  tracking  number  noted  in  the  box  at  the  bottom  of  the 
page  (See  Figure  3). 

After  all  of  the  tools  were  rated,  a  prioritization  scheme  was  used  which  reflected  the  results 
of  the  application  of  the  criteria.  The  procedure  adapts  a  three  tier  approach  to  tool  assessment, 
and  results  in  classification  of  a  tool  by  Category,  Desirability  Level,  and  Priority.  The  Advanced 
Tool  Assessment  Form  used  in  prioritizing  the  tools  is  presented  in  Table  3. 

Category  I  tools  are  operational  tools  that  are  commercially  available  for  immediate 
implementation.  Category  II  tools  are  also  commercially  available,  but  represent  tools  in  the 
prototype  or  beta  stage  of  development.  Category  III  tools  include  both  proprietary  tools,  and  tools 
that  will  be  commercially  available  but  at  the  present  time  are  conceptual  in  nature  and  have  not  yet 
been  built.  Tools  that  fall  under  the  third  category  were  not  prioritized  due  to  the  lack  of  available 
information. 

Tools  were  also  classed  according  to  their  desirability  level,  as  defined  below: 

•  Level  A  -  good  adaptability  and  high  utility 

•  Level  B  -  good  adaptability  but  low  utility 

•  Level  C  -  poor  adaptability  but  high  utility 

•  Level  D  -  poor  adaptability  and  low  utility 


Tool  Name 


1.  Availability 

Proprietary  -  Commercial 

2.  Accessibility 

Conceptual  _ 

Prototype  - 

Operational 

3.  Adaptability 

Poor  - 

Good  - 

4.  Utility 

Low  - 

High 

5.  Training 

Rigorous  - 

Minimal  - 

6.  Mobility/ 

Portability  Poor  - 

Good 


Figure  2.  Tool  Categorization  Form 
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Table  3.  Advanced  Tool  Assessment  Form 


Tracking!  Availability  Accessibility  Adaptability  Utility  Training  Mobility  Cat  Level  Priority 
No. 


Proprietary 

Commercial 

NA 

Conceptual 

Commercial 

Prototype 

Operational 


The  final  factor  in  selecting  advanced  tools  is  the  priority  rating.  This  number  is  found  in  the  last 
column  in  Table  3.  After  completing  the  Trade-off  Criteria  Decision  Tree  Form,  the  tracking 
number  located  on  the  bottom  of  the  form  is  used  as  the  initial  entry  to  the  Advanced  Tool 
Assessment  F'orm.  The  entry  position  in  the  first  column  is  then  tracked  horizontally  across  Table 
3  until  a  Priority  number  is  reached  in  the  last  column.  The  priority  number  assigned  to  a  tool 
represents  a  quantitative  distinction  among  the  tools  in  the  data  base.  This  number  reflects  the 
priority  which  should  be  given  to  the  selection  of  a  tool,  when  tools  of  a  similar  type  and  class  have 
been  identified. 

2.5.3  RESULTS 

The  results  of  the  trade-off  process  can  be  found  in  Appendix  B.  Presented,  in  the  table, 
from  left  to  right,  is  the  tool's  record  number,  which  corresponds  to  the  record  number  used  to 
access  the  tool  in  the  data  base.  The  name  of  the  tool  is  presented  next,  followed  by  information 
used  to  classify  the  tool  (i.e.,  MAP  Phase,  HFE  Activity  Area,  Tool  Type,  Tool  Class),  and  the 
priority  assigned  to  the  tool.  Tools  designated  with  a  0  are  either  Proprietary  or  Conceptual,  and 
were  therefore  excluded  from  the  assessment  process.  The  last  column  presents  the  overall  cost 
assessment  of  the  tool,  which  is  taken  from  Appendix  C.  Given  similar  capabilities,  and  for  tools 
of  the  same  Type  and  Class,  consideration  should  be  given  to  the  tool  with  the  highest  priority 
classification  (lowest  number)  and  the  lowest  cost.  It  should  be  emphasized  that  the  tools  priority 
ranking  is  based  on  an  ordinal  scale  of  measurement,  and  should  therefore  only  be  used  as  a 
general  guide  when  selecting  tools. 

Appendix  C  presents  the  cost  criteria  which  were  used  as  the  basis  in  determining  the  overall 
affordability  of  a  tool.  A  tools  overall  cost,  presented  as  Low,  Moderate,  or  High,  represents  an 
integration  of  four  different  cost  considerations.  The  first,  Acquisition  Cost,  refers  to  the  sum  of 
money  required  to  procure  a  tool.  An  attempt  was  made  to  provide  information  on  the  absolute  cost 
of  a  tool,  when  this  information  was  available.  In  most  cases,  it  was  not.  The  development  of 
many  of  the  tools  in  the  database  was  funded  by  government  agencies.  Since  these  tools  fall  within 
the  public  domain,  they  normally  can  be  released  free  of  charge  (except  for  the  cost  to  reproduce 
them),  to  Federal,  state  and  local  government  agencies.  These  tools  received  a  score  of  "None" 
under  the  category  Acquisition  Cost.  Tools  costing  less  than  or  equal  to  $1,000  were  scored 
"Moderate”  on  the  acquisition  cost  category,  while  tools  costing  in  excess  of  $1,000  were  labeled 
"High”  acquisition  cost. 

The  next  category,  Setup  Cost,  refers  to  the  amount  of  front-end  work  required  on  the  part  of 
the  user  before  a  tool  can  be  implemented  effectively.  Such  costs  were  designated  "Low,” 
"Moderate,"  and  "High,"  and  were  determined  subjectively  through  both  verbal  and  narrative 
descriptions  of  the  tool,  and  by  conferral  among  the  reports  authors. 

The  third  category,  Training  Cost,  was  included  to  differentiate  tools  by  the  amount  of  time 
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required  for  a  user  to  become  proficient  in  their  use.  A  "Low"  training  rating  was  assigned  to  any 
tool  that  could  be  mastered  in  one  day.  A  tool  requiring  up  to  three  days  for  a  novice  user  to  learn 
received  a  rating  of  "Moderate."  Tools  requiring  more  than  three  days  to  learn  were  rated  "High." 

The  final  category  was  Resource  Costs  or  costs  associated  with  the  computer  system  for 
which  the  tool  was  designed.  Tools  were  rated  "High"  in  resource  costs  if  a  mainframe  computer 
was  required  to  run  them.  A  tool  was  rated  "Low"  if  it  could  run  on  a  microcomputer. 

Overall  cost  ratings  were  obtained  by  averaging  the  ratings  over  the  individual  cost 
categories.  The  Overall  Cost  rating  could  be  "Low,"  "Medium,"  or  "High"  based  on  an  equal 
weighting  of  the  four  categories. 

Regarding  recommendations  for  specific  tools,  operational  tools  with  good  adaptability  and 
demonstrated  utility  which  fall  toward  the  low  to  moderate  end  of  the  cost  spectrum  are 
recommended  for  procurement  by  the  Army.  Such  tools  are  all  Category  I,  Level  A  tools,  with 
priority  ratings  between  1  and  4.  A  total  of  12  tools  exhibit  the  above  characteristics,  and  are 
identified  below: 


•SIMWAM 

•  HF-ROBOTEX 

•  GRASP 
•ZITA 

•  MicroS  AINT 


DART 

■  WOSTAS 

■  WORG 

■  GEOMOD 

■  CADAM/ADAM  &  EVE 

■  CAPRA 


While  the  above  twelve  technologies  do  not  represent  an  inclusive  set  of  advanced  tools 
which  can  be  applied  to  all  problems  encountered  within  the  field  of  human  factors  engineering, 
they  do  represent  the  best  Types  of  tools  within  their  respective  tool  Classes.  Although  the 
recommendations  are  based  on  a  thorough  review  of  the  literature  and  on  conversations  with  tool 
developers  and  people  experienced  in  applying  the  tools,  the  authors  did  not  have  the  opportunity  to 
test  the  tools  reported  herein  individually. 

Potential  tool  users  should  also  bear  in  mind  that  recommendations  for  the  above  tools  are 
only  as  good  as  the  task  the  human  factors  specialist  is  faced  with.  Therefore,  given  mission 
objectives,  the  specialist  should  select  the  tool(s)  which  best  satisfy  the  requirements  of  the  task 
objectives.  To  facilitate  the  selection  of  the  ideal  advanced  tool,  a  human  factors  engineering 
advanced  tools  database  has  been  created.  This  database  offers  unlimited  query  capabilities  to 
allow  the  human  factors  specialist  to  custom  tailor  a  .  earch  to  meet  the  specific  objectives  of  the 
task.  The  generic  search  features  built  into  the  database,  including  the  Custom  Search  Menus  and 
Quick  Query  feature,  are  fully  described  in  the  database  User's  Guide  presented  in  Appendix  D. 
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3.0  RECOMMENDATIONS 

The  specific  tools  already  in  existence  which  should  be  procured  are  heavily  dependent  upon 
the  functions  the  tools  are  to  perform.  Assuming,  of  course,  that  the  functional  requirements  have 
been  met,  those  advanced  tools  which  possess  the  capabilities  of  satisfying  task  objectives,  and 
which  rated  favorably  in  the  trade-off  process,  are  those  recommended  for  procurement  and  use. 

The  results  of  this  study  indicate  that  advanced  tools  running  on  a  microcomputer  for  use 
within  military  R&D  and  T&E  programs  would  be  a  welcome  addition  to  the  Army's  standard  tool 
set.  When  looking  at  the  frequency  of  citations  for  a  particular  type  of  advanced  tool,  the  data 
clearly  indicate  that  automated  task  analysis  programs,  human  factors  data  base  compendiums, 
workload  prediction  tools,  and  expert  systems  were  all  in  the  forerunning.  In  selecting  among  the 
general  types  of  tools  requested  for  future  development,  the  specific  tool  which  should  be 
developed  during  the  Phase  II  effort  should  be  one  which  best  supports  the  objectives  of  the  Phase 
I  task  as  delineated  in  the  RFP  and  corresponding  technical  proposal. 

The  research  conducted  during  the  course  of  this  contract  was  intended  to  support  the 
initiatives  of  the  Army's  MANPRINT  program.  As  part  of  another  MANPRINT  study  conducted 
by  Carlow  Associates  and  FMC  within  the  FMC  IR&D  program,  a  subtask  was  undertaken  to 
identify  the  tools  involved  for  each  of  the  MANPRINT  domains.  The  results  yielded  the 
identification  of  over  100  models,  methods  and  data  bases  used  in  support  of  the  MANPRINT 
process,  spanning  the  domains  of  HFE,  MP&T,  UHA,  and  SS.  The  Phase  I  scope  for  the  present 
study  was  limited  to  those  advanced  tools  presently  used  by  the  human  factors  community;  data 
bases,  along  with  manual  techniques  and  methods,  were  not  of  primary  concern  and,  therefore, 
were  not  subjected  to  the  rigorous  classification  and  categorization  scheme  developed  to  screen 
existing  advanced  tools. 

A  recommendation  for  future  work  would  be  to  combine  the  results  of  the  present  study  with 
the  results  of  the  previous  MANPRINT  study,  and  use  this  aggregate  as  a  springboard  into  the 
development  of  a  standard  front-end  analysis  (FEA)  process  based  on  existing  and  proposed 
human  factors  engineering  technology.  The  technology  to  be  surveyed  should  incorporate  the 
advanced  tools  identified  during  this  Phase  I  SI3IR  with  the  traditional  manual  techniques, 
procedures,  models  and  data  bases  surveyed  during  the  IR&D  program,  to  study  the  MANPRINT 
process  as  applied  to  Army  systems  The  resulting  product  would  be  documentation  of  the  role 
HFE  technology  plays  during  FEA  in  major  weapon  system  acquisitions.  Corollary  products 
might  include  the  development  of  software  technologies  identified  as  necessary  for  facilitating  die 
front  end  analysis  process.  and  possibly  even  a  knowledge  oriented  data  base  or  expert  system 
which  could  be  used  for  selecting  the  HFE  technologies  available  during  the  FEA  preceding  the 
acquisition  of  major  systems.  Such  an  approach  would  satisfy  both  the  letter  and  intent  of  the 
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Phase  I  scope  by  providing  a  tool  or  tools  which  compliment  the  objectives  of  the  MANPRINT 
program,  while  simultaneously  ensuring  that  the  resulting  product  is  one  which  is  desired  by  the 
human  factors  practitioners  within  the  military  sector. 

In  responding  the  the  question  regarding  the  advanced  tools  preferred  for  adaptation  to  a  desk 
top  computer,  the  microcomputer  of  choice  for  future  software  adaptation  or  development  was  the 
Apple  Macintosh.  This  response  is  not  surprising  in  that  over  a  decade  of  human  factors  research 
went  into  the  development  of  the  interface  for  this  particular  machine  (over  30  work  years  if  one 
considers  the  Xerox  8010  Star  Information  System  as  the  father  of  the  Macintosh).  The  research 
on  cognitive  modeling  conducted  during  the  R&D  phases  associated  with  these  two  machines 
resulted  in  the  birth  of  the  desktop  metaphor  and  the  introduction  of  direct  manipulation  languages. 
In  developing  the  interface  for  these  machines,  the  user's  conceptual  model  was  developed  before 
the  software  was  written.  The  interface  was  designed  before  the  functionality  of  the  system  was 
fully  decided,  even  before  the  computer  hardware  was  built  (Smith  et  ah,  1982).  The  positive 
response  to  the  Macintosh  is  due  largely  to  this  interface  which  supports  both  rapid  skill  acquisition 
and  retention  over  time.  For  these  reasons,  any  software  planed  for  future  development  on  a 
microcomputer  by  the  Army  should  be  configured  with  a  Macintosh  in  mind. 
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Based  on  CAPE  model 
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•  modified  version  of  CALSPAN  3D  CVS  Model 

•  modification  done  by  the  Air  Force 


** 


■o 


O 

u 

<u 


C< 


wo 

>> 

T3 

O) 

« 

a* 

c* 

c 


< 


ir 


O 


C3 


cli 

/ 

J 

O 

o 

H 


A-101 


_%  A  -v  *  '  .  *  A  .  ■  A*  ^  «  •  A  Aji  'j.  "j  v  *A-'^  ,V. 


^  ^ %'a^’a" a'a  aV^’a  - v" 


COMMKNTS 


COMMENTS _ _ 

Rockwell  won't  release  the  program  commercially  or  by  special  permission. 


FSD 

o 

H 

** 

e 

c 

n 

£ 

u 

c/; 

u 

U3 

u« 

a. 

J 

Cl 

— 1 * 

CL 

o 

>• 

CL 

< 

OC 

H 

COMMENTS 


A-l  1 1 


ra 


K* 

V' 

>v- 


3 


4 


W\- 

'.'•V 

•y1 


Z> 


v.-y 


-.%4 


.Vv? 

V*NJ 


'!vl(!^v'',.'>.-.‘'-.  CvCva 


^  —*»  -*"  t-*Mt  -'V^'V  > 


bZmlt£*  -v  1  *■»*«  kJk  A  Jfri  -**  yVkJM 


*iS  V 

i  i  i  i  - 


COMMENTS _ 

Unavailable  commercially  or  by  special  permission 


_ CLASSIFICATION  _ 

PHASE  |  FSD  CLASS  •  reach 

APPLICATION  1  advanced  |  ACTIVITY  |~T&E  '  v>sion 

p  •  man-modeling  in  3-D  environments 


COMMENTS 


COMMENTS 


.*,4.1 


,IM 


O  *- 

I  - 

<L> 

t  E  x: 
O  o 

*-  C  o 
o  o  *- 
.  00  -c 
c  P 
-2  T*  3 


1 « I 

O  **  ~  t 


I  S3 
■3S|T. 
=  I  a  • 

<0  £_  C 
°  .2, 
o,D  >. 
C  U.  -o 

a  M  £  ■ 

s  "  o  • 

c  >.  i  - 

-S  g.2 

V,  X)  V,  i 

o  —  o 


o  «a  ^ 
u  *> 
c  >.  i 

-S  g.2 


cap 

I  .8  5 

N»  T3  o 
13  O  >- 

U  »M 


3  2  - 
M  M  O 

•*  -n  on 


u  C  W 

£  s  K 


*J  c  OO  ' 

u  g  ^  : 
o.S-o 

eg  oo 

E  o  ■ 

“  S  o 

°°2  S 


5 

S  . — 

a,  -J  o 


a,  -J  o 

.2  .5 

5  c  r 


«  H  o 

3  c 
>.  * « 
e  e  Q 

<rt 


!2  C  a 
f*  C  V 


b  2  E 
o  S  £ 
S3 


w 

■<  o  __ 
E  * 

s  >  c 

•I  I -s 


O  -p 
«p  i,  M 
O  i*  u 

S  -  J 
u  a  " 


Z  (do 
W  H  >. 

”  3  -K 

' ■j'. 

x  fc"  -5  js 

z)  o  5  c 

o  g  i 

td  u  h 

SC  cr 

o  «« 

V)  u 


DA.V,  FSD _  CLASS  •  workstation  design 

TION  |  advanced  1  ACTIVITY  |  design 
•  clinical  assessment  of  movement  abnormalities 


S 


y 


3? 


£ 


.•V' 

V 


fi 


s 


,v 


£ 


.v 


V 

V 
v 


s 

N* 


►  s 


!IIWW*T 

'SI 


s 


a 

■A 

'  "A 


3 


$ 


& 


:’:-a 


'  % 


vj 


:-1 


:•;> 

•".*> 


sol 

M 

/< 


•-•S 
•  .  * 


'• 


••-.-1 


\ 


:3 


*.■-•„%  .  •.^,~'V  y  -  .V;. 1 


V  .-  /■.  v  -.  Vvlv 

^-*  -  -*■*-  -  — *-  ■  — *  -  «A 


*»**“<'*'» 


*,*  *  /  '.•  *  ■  *.«  \«  '.• '/  v'.1  *,*  W  */  k^%»*  '.‘V  *  *  *  •  ’.^  «s  ^  «.N>  <. %  *  . '  .'*  *^j 

_nv  .viv-v-v.-.-.v.v.v.i. .v.wj 


different  technique.  Validation  results  were  considered  good. 
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Final  funding  for  the  project  debugging  and  documentation  was  delayed;  it  is  expected  to  be  completed  by  the  end  of  FY  87. 
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Tbul  Name:  SAJKT  (Systems  Analysis  of  Integrated  Netvoiks  of  Tasks)  I&H 
Pr0duCl  HFE  Activity:  analysis,  T&E 

Improvement 


Using  the  Quick  Query  Function 
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Printing  Your  Selections 


records  in  that  group  you  wish  to  print.  For  example: 

•  rrom:|  9  |  To:]  15  I 

JE  menu.  You  must  set  up  the 

i  if  you  have  just  completed  a  Printing  function  will  proceed  consistent  with  Macintosh 

Landscape"  option  on  the  page  capabilities.  See  pages  9  and  10  for  an  example  of  the  hard  copy 
iple  at  top  of  next  column).  record  forms  for  advanced  HFE  tools. 
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APPENDIX  E 


HUMAN  FACTORS  ENGINEERING 
TOOLS  QUESTIONNAIRE 


'/>  V'/W  W  W'/  V  V  V  >  '/  V 


INTRODUCTION 


Carlow  Associates  Incorporated  is  under  contract  to  the  U  S.  Army  Human  engineering 
Laboratory  (11LL)  to  identity  tools  which  are  currently  used  by  human  factors  (Hl:)  specialists  in 
the  daily  conduct  of  their  jobs.  Anthropometers,  task  analysis,  sound  pressure  level  meters,  and 
link  analysis  are  just  a  few  of  the  typical  tools  which  are  used  by  the  human  factors  researcher. 
Outside  of  these  mainstream,  manual,  or  traditional  tools  generally  associated  with  human  factors 
engineering  are  tools  which  do  not  readily  elicit  recognition  due  to  their  novelty  or  general  lack  of 
citation  in  the  human  factors  literature.  For  example,  SAINT,  CAFFS,  SAMMIE,  and 
COMBIMAN  are  several  automated  or  computerized  aids  which  have  been  introduced  in  recent 
years.  Unfortunately,  the  application  and  utility  of  these  alternative,  computerized  or  advanced 
tools  by  HF  engineers  have  been  largely  unexplored. 

The  questionnaire  which  follows  represents  the  first  of  several  steps  in  the  process  of 
identifying  HF  tool  requirements  within  the  military,  industrial,  and  government  (MIG)  setting, 
and  comparing  them  to  existing  capabilities  within  the  system  acquisition  process.  The  objective  of 
this  questionnaire  is  to  identify  the  traditional  and  advanced  human  factors  engineering  tools 
which  are  presently  used  in  laboratories  and  field  settings  throughout  the  MIG  community,  and  to 
identify  the  capabilities  of  the  advanced  tools  in  replacing  or  augmenting  the  more  traditional  tools 
typically  associated  with  human  factors  research.  The  goal  at  the  conclusion  of  the  study  is  to 
provide  the  Army  with  recommendations  for  an  advanced  tool  set,  along  with  a  list  of  conceptual 
tools  recommended  for  development  based  upon  their  potential  for  simplifying  and  expediting 
military  development  and  operational  test  and  evaluation. 

You  have  been  selected  as  a  candidate  for  this  study  due  to  your  unique  qualifications  for 
satisfying  the  selection  criteria  (i.e.,  currently  managing  or  performing  human  factors  research  for 
the  Department  of  Defense  and/or  having  prior  direct  involvement  in  the  development  or  testing  of 
a  human  factors  engineering  tool).  A  positive  response  to  this  questionnaire  is  imperative  in  order 
to  document  existing  HF  technology  shortfalls.  As  experts  in  the  field  of  human  factors 
engineering  or  tool  development,  your  knowledge  and  opinions  are  considered  valuable 
contributions  to  the  overall  tool  identification  effort.  Please  answer  all  of  the  questions  as 
completely  as  possible.  Additional  instructions  follow: 

•  Please  complete  the  biographical  information  requested  on  the  following  page. 

•  Most  of  the  questions  will  require  a  YES  or  NO  answer,  with  some  additional 
information.  Please  be  as  specific  as  possible  with  answers  requiring  explanatory 
information. 

•  When  you  have  comments  or  suggestions,  use  the  space  provided  below  each  question.  If 
you  need  additional  room,  use  the  backs  of  the  sheets. 

•  If  possible,  all  questionnaires  should  be  completed  within  five  working  days  of  initial 
receipt. 

•  F'or  your  convenience,  an  addressed  and  stamped  envelope  has  been  included  with  the 
questionnaire. 

•  When  you  finish  the  questionnaire,  simply  place  it  in  the  envelope  and  drop  it  in  the  mail. 

•  Thank  you  for  your  cooperation;  your  efforts  are  greatly  appreciated. 

Respectfully, 

CARLOW  ASSOCIATES  IN  CORPORA  FED 


Thomas  B.  Malone,  Ph  D. 
Principal  Investigator 


1.  1 
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BIOGRAPHICAL  DATA  SHEET 


Name: 


Organization  (Company/Institution): _ _ 

Occupation  (Profession): _ _ _ _ _ 

Current  Position  (Title): _ _ 

Major  or  specialities  (e.g.,  psychology,  business,  engineering,  etc.)  listed  in  order  of  highest 
degree  or  most  experience: 


1.  Years  of  experience  in  present  occupation? _ _ 

2.  Please  select  the  sector  in  which  you  are  currently  employed. 

Private  Industry _ 

Government _ 

Military _ 

3.  Please  select  the  appropriate  role(s)  which  best  describe  your  current  function. 

Management: 

Corporate _ 

Technical _ 

Other _ 

Consulting _ 

Education 

R&D 

T&E _ 

Other _ _ _ 

4.  If  your  mailing  address  has  changed  or  is  incorrect,  please  provide  an  updated  address  below: 


Organization 


Department 

Address 


Telephone:  ( _ )  _ 


l 

Ct 

C 

Ct 

krCi 
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QUESTIONN  A  IRK 

1.  Do  you  use  human  factors  tools  (e.g.,  task  analysis,  photometers,  SAINT,  etc.)  in  the 
performance  of  your  job? 

Note: 

If  no,  then  please  proceed  to  question  12. 

YES  NO 

2.  Have  you  ever  been  involved  in  the  development  of  human  factors  tools?  YES  NO 

If  yes,  please  list  the  names  of  the  tools  and  provide  a  brief  description  of  the  tools'  objectives. 


4.  Docs  your  work  involve  the  development  or  use  of  human  factors  tools  within  the  aviation 
community? 

YES  NO 

It  no,  then  please  proceed  to  question  9.  If  yes,  then  please  list  below,  in  descending  order  of  use 
or  importance,  those  human  factors  tools  used  most  frequently  or  that  are  viewed  as  most 
important  in  the  performance  of  your  aviation  related  work. 


5.  Please  describe  briefly  the  objective  and  primary  applications  for  Tool  1 


6.  For  each  of  the  tools  listed  in  question  4,  please  identify  the  tool's  utility  as  being  either  specific 
to  aviation  work  or  generalizable  to  applications  other  than  aviation  (circle  one  response  for  each 


tool). 

Tool  1 .  Aviation  Specific  Generalizable 

Tool  2 . Aviation  Specific  Generalizable 

Tool  3 .  Aviation  Specific  Generalizable 


7.  Are  the  requirements  of  your  job  satisfied  by  the  capabilities  offered  or  features  available  for  the 
tools  identified  in  question  4? 

YES  NO 

If  no,  then  please  describe  the  limitations,  drawbacks,  problems  and  disadvantages  associated  with 
tool  use. 


8.  What  new  tool  would  you  like  to  see  developed  that  would  facilitate  your  aviation  related  work? 


9.  Please  list  below,  in  descending  order  of  use,  those  human  factors  tools  (other  than  those  listed 
in  questions  4  through  8)  that  are  used  most  frequently  or  that  are  viewed  as  most  important  in  the 
performance  of  your  (non-aviation  related)  work. 

Tool  A:  _ _ 

Tool  B:  _ _ _ _ 

Tool  C: 


10.  Please  describe  briefly  the  objective  and  primary  applications  for  Tool  A. 


1 1.  Are  the  requirements  of  your  job  satisfied  by  the  capabilities  offered  or  features  available  for 
the  tools  identified  in  question  9? 


If  no,  then  please  describe  the  limitations,  drawbacks,  problems  and  disadvantages  associated  with 
tool  use. 

Tool  A: 


Tool  B: 


Tool  C: 


12.  Are  you  aware  of  any  on-going  program(s)  to  develop  new  tools  which  have  the  potential  for 
use  within  the  field  of  human  factors  engineering? 

YES  NO 

If  yes,  please  give  the  name  of  the  tool,  the  manufacturer  or  agency  for  whom  the  tool  is  being 
developed,  and  a  brief  description  of  the  tool. 


HU 


13.  Are  you  building  or  involved  in  the  development  of  any  new  human  factors  tools? 


YES  NO 

If  yes,  then  please  provide  a  brief  description  of  the  tool  below.  Include  in  your  description  the 
purpose  for  tool  development,  the  input  requirements  or  prerequisites  necessary  for  tool  use,  and 
the  output  or  expected  results  from  application  of  the  tool. 


14.  Do  you  feel  there  ts  a  need  within  the  human  factors  community  for  new,  more  advanced 
tools? 

YES  NO 

If  yes,  please  describe  the  type  of  tool  or  tools  you  would  like  to  see  developed. 


If  yes,  then  please  describe  the  application  you  would  like  to  see  modified. 


Mr.  Terrence  S.  Abbott 
y  NASA  Langley  Research  Center 
p  Mail  Stop  152  E 
!  Hampton,  VA  23665-5225 


Dr.  Christopher  J.  Arbak 
McDonnell  Douglas  Corporation 
E  422/33/6/MS  1 72 
P.O.  Box  516 
St.  Louis,  MO  63166 


Mr.  Dave  Barnthouse 
AFHAL/LRG 

Wright-Patterson  AFB,  OH  45433 


*■  Ms.  Deborah  Birkmire 
L  Behavioral  Research  Directorate 
■  Director,  US  Army  Laboratory  Command 
Human  Engineering  Laboratory 
£  Aberdeen  Proving  Ground,  MD 
'  21005-5987 

R  Ms.  N.  Joan  Blackwell 
r  US  Army  Research  Institute 
L;  ATTN:  PERI-IR 
E  BLDG  501  (N.J.  Blackwell) 

|  Pt.  Rucker,  AL  36362-5354 


r<  Capt.  James  A.  Boylcss 
t  Department  of  Management 
>  HQ  USAFA/DFM 
k  Colorado  Springs,  CO  80840 


Mr.  Donald  M.  Allen 
Old  Dominion  University 
Department  of  Psychology 
Hampton  Blvd. 

Norfolk,  VA  23508 

Capt.  Anthony  J.  Aretz 
HQ  USAFA/DFBL 
Behavioral  Sciences  Department 
USAF  Academy,  CO  80840 


Dr.  R.P.  Bateman 
Boeing  Military  Airplane  Co. 
Crew  Station  Technology 
M/S  K76-23 

Wichita,  KS  67277-7730 

Dr.  Alvah  C.  Bittner,  Jr. 
Analytics,  Inc. 

2500  Maryland  Road 
Willow  Grove,  PA  19090-1216 


Dr.  Deborah  A.  Boehm-Davis 
George  Mason  University 
Psychology  Department 
4400  University  Drive 
Fairfax,  VA  22030 


Dr.  Hugh  Burns 
AFHRL/IDI 

Brooks  Air  Force  Base,  TX  78235-5601 
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Richard  S.  Camden 
Army  Human 


X.  US 
S  CSSD 


Engineering 


Lab 


I 


Attn:  SLCHE-CS  (Camden) 
Aberdeen  Proving  Ground,  MD 
21005-5001 


Mr.  Gerald  Chaikin 

Chief,  HEL  Detatchment-MICOM 

Attn:  SLCHE-MI  (Chaikin) 

US  Army  Missile  Command 
Redstone  Arsenal,  AL  35898-7290 


>  Mr.  George  J.  Chambers 

Dr.  W.  Peter  Cherry 

*  Hughes  Aircraft  Co. 

Vector  Research,  Inc. 

?■  Engineering  Services  Department 

P.O.  Box  1506 

P.O.  Box  3300  606/K225 

Ann  Arbor,  MI  48106 

*  Fullerton,  CA  92634 

,  Mr.  Jeffery  A.  Cochran 

Mr.  Andrew  Cohen 

333  N.  Fairfax  Street 

Hughes  Aircraft  Co.,  GSC 

Alexandria,  VA  22314 

Combat  Systems  Department 

v" 

r  * 

1901  Malvern  Bldg,  691/B217 

Fullerton,  CA  92634 

•Mr.  Edward  M.  Connelly 
Performance  Measurement  Associates 
1625  Autumnwood  Dr. 

*  Reston,  VA  22094 

w- 

*  ^ 

> 

^Dr.  Thomas  P.  Cullinane 
'  University  of  Notre  Dame 
V-Dept.  of  Aerospace  and  Mechanical 
^Engineering 
Notre  Dame,  IN  46556 

§ 

^.Dr.  James  W.  Dees 
2>US  Army  Aviation  Center 
ATZQ-TD-ST 
^„Ft.  Rucker,  AL  36362 


Bernard  M.  Corona 
Inc.  Human  Engineering  Lab 

US  Army  Laboratory  Command 
Chief,  IS  ABED 
SLCHE-IS  (B.  Corona) 

Aberdeen  Proving  Ground,  MD 

B.  Davall 

Armament  Systems  Inc. 

Box  158 

Aberdeen,  MD  21001-0158 


Guy  E.  Dickey 
General  Dynamics  Corp. 
Box  748 

Ft.  Worth,  TX  76101 


w 
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Don  Egner 
US  Army  Human 
Aberdeen  Proving 


Engineering  Lab 
Ground,  MD  21005 


I 

^  Dr.  Jason  Erlichman 
Hughes  Aircraft  Co. 
*  GSG,  MS  618/Ml  11 
l'  Box  3310 

Fullerton,  CA  92634 


N  Mr.  Robert  M.  Fickling 
^  US  Army  AVSCOM 
AMSAV-ESC 
4300  Goodfellow  Blvd. 

St.  Louis,  MO  63120-1798 

:? 

-  Mr.  Michael  N.  Frarcher 
j-  Essex  Corporation 
PTest  and  Evaluation  Department 
333  N.  Fairfax  Street 
£  Alexandria,  VA  22314 
y' 


^Mr.  Clarence  A.  Fry 

US  Army  Human  Engineering  Lab 
.  -  DRXHE-AD 

^•Aberdeen  Proving  Ground,  MD  21005 


v 

V 


Dr.  Martha  J.  Gordon 
Mac  Au  lay- B  row  n 
3915  Germany  Ln. 
iDayton,  OH  45431 
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Ronald  A.  Erickson 
US  Naval  Weapons  Center 
Code  31504 
China  Lake,  CA  93555 


Dr.  John  Farbry 
Essex  Corp. 

333  N.  Fairfax  St. 
Alexandria,  VA  22153 


Ms.  Dorothy  L.  Finley 
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